asynchronous multi-llm framework
AsyncMLD: Asynchronous Multi-LLM Framework for Dialogue Recommendation System
Yoshimaru, Naoki, Okuma, Motoharu, Iio, Takamasa, Hatano, Kenji
Abstract-- We have reached a practical and realistic phase in human-support dialogue agents by developing a large language model (LLM). However, when requiring expert knowledge or anticipating the utterance content using the massive size of the dialogue database, we still need help with the utterance content's effectiveness and the efficiency of its output speed, even if using LLM. Therefore, we propose a framework that uses LLM asynchronously in the part of the system that returns an appropriate response and in the part that understands the user's intention and searches the database. In particular, noting that it takes time for the robot to speak, threading related to database searches is performed while the robot is speaking. This is an for actual automatic ticket sales or searching a large database asynchronous operation that separates (A) the system that and modifying the conversation based on the results.
- Asia > Japan > Honshū > Kansai > Kyoto Prefecture > Kyoto (0.06)
- North America > Dominican Republic (0.05)
- Asia > Japan > Kyūshū & Okinawa > Kyūshū > Fukuoka Prefecture > Fukuoka (0.05)